This directory contains the source code to systematically crawl TikTok videos under a cumulative list of trending hashtags on the Discover page. 

1) scrape_tt returns all trending hashtags on the Discover page on a specific day and crawls all visible videos displayed under those currently trending hashtags as well as all the old trending hashtags that have been crawled before. 

1) comparedays_new outputs the hashtag difference between day i and j which is used to check for newly added hashtags between two (mostly consecutive) days. 


3) download_tt/download_tt1 downloads the full length videos from the TikTok website using the downloading address crawled from scrape_tt
